Improving the Performance of Weighted Lagrange-Multiplier Methods for Nonlinear Constrained Optimization

Nonlinear constrained optimization problems in discrete and continuous spaces are an important class of problems studied extensively in arti®cial intelligence and operations research. These problems can be solved by a Lagrange-multiplier method in continuous space and by an extended discrete Lagrange-multiplier method in discrete space. When constraints are satis®ed, these methods rely on gradient descents in the objective space to ®nd high-quality solutions. On the other hand, when constraints are violated, these methods rely on gradient ascents in the Lagrange-multiplier space in order to increase the penalties on unsatis®ed constraints and to force the constraints into satisfaction. The balance between gradient descents and gradient ascents depends on the relative weights between the objective function and the constraints, which indirectly control the convergence speed and solution quality of the Lagrangian method. To improve convergence speed without degrading solution quality, we propose an algorithm to dynamically control the relative weights between the objective and the constraints. Starting from an initial weight, the algorithm automatically adjusts the weights based on the behavior of the search progress. With this strategy, we are able to eliminate Information Sciences 124 (2000) 241±272 www.elsevier.com/locate/ins * Corresponding author. Fax: +1-573 882-8318. E-mail addresses: [email protected] (B.W. Wah), [email protected] (T. Wang), [email protected]://manip.crhc.uiuc.edu (Y. Shang), zhewu@manip. crhc.uiuc.edu (Z. Wu). 0020-0255/00/$ see front matter Ó 2000 Elsevier Science Inc. All rights reserved. PII: S 0 0 2 0 0 2 5 5 ( 9 9 ) 0 0 0 8 1 X divergence, reduce oscillation, and speed up convergence. We show improved convergence behavior of our proposed algorithm on both nonlinear continuous and discrete problems. Ó 2000 Elsevier Science Inc. All rights reserved.